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Procedures and findings of three reading comprehension studies are reported. 
The first study compared cloze readability test scores for 130 pairs of students 
(grade 3 through college) with scores indicating the information gained from reading. 
Students gained little or no information when they could not answer more than 2o 
percent of the cloze test items, but when they could answer as many as 35 percent, 
they were able to gain approximately as much information as students with greater 
reading ability. The second study determined the reading achievement grade 
placement scores of students who could answer 35 percent of the items on cloze 
readability tests made from subject matter area materials used at various school 
levels. The mean grade level at which students could read 35 percent of the items 
was 7.6 for primary-grade materials, 8.6 for intermediate, 9.4 for junior high school, 
and 10.4 for high school. The third study tested 240 students* understanding of 
simple factual information signaled by structures commonly found in written language. 
Almost one-fourth of the children were unable to comprehend one-half of the easiest 
sets of structures tested, and only 58 percent could use between-sentence syntax to 
comprehend. Tables and references are included. (CM) 
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John R. Bormuth 
University of Chicago 

Most eiucators agree that the ultimate purpose of teaching reading is to 
enable students to understand what they read, not just to permit them to cal 1 
the words printed on a page* The logic supporting this position seems irre- 
futable. The child must gain much of his knowledge from reading written 
instructional materials. If he cannot comprehend those materials, he is likely 
to fail in school, drop out, and live his adult life marginally employable and 
on the margins of the culture. It has long been obvious that functionally 
illiterate people constitute a social and economic burden for society. However, 
it is now becoming evident that the tragedy of their personal failure and 
frustration probably has social consequences far deeper than their simple effects 
upon the economy. Thus, we can generally agree that schools should spare no 
effort in teaching children to comprehend written language. 



9ut merely agreeing that we should teach a set of skills falls far short of 
actually accomplishing that objective. This paper will describe a series of 
studies which, when taken together, provide a fairly adequate evaluation of the 
effectiveness with which schools teach the reading comprehension skills. These 
studies provi .!e a strong basis for the claims that (a) a vast number of students 
never sufficiently master the skill of reading comprehension to enable them to 
acquire the knowledge contained in their instructional materials, and (b) this 
fact is probably attributable to the ineffectiveness of instruction in reading 
comprehension. 



CO 






Students' Ability to Comprehend their Instructional Materials 

This section will report research which indicates that students, as a rule, 
do not read well enough to learn the knowledge contained in their textbooks. 
Specifically, it appears doubtful that most elementary and junior high school 
students can learn much, if anything, from their instructional materials. By 
the time the students reach high school , it appears that more of them can under- 
stand their instructional materials, but even this result may be misleading. 

But before we can examine this study, it will be necessary to describe a 
different and more basic study. This more basic study showed that materials 
can be divided more or less sharply into two groups, those from which a child 
can gain little or no information and those from which he can gain a substantial 
amount of information. hether or not the child is able to gain knowledge from 
a given text depends upon whether he has sufficient reading ability to attain a 




This paper was delivered at the Annual Convention of the National Council of 
Teachers of English in Milwaukee, Wisconsin, on November 39, l$68. 
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criterion level of performance on a cloze readability test made from the text. 
The second study v/i 1 1 then demonstrate that many children do not have sufficient 
comprehension ability to reach this criterion level on cloze readability tests 
rnaie from the instructional materials they are required to study. 



Information Gain as a Function of the Ease of a Text 

The purpose of this first study was to determine how the difficulty of a 
text influences the amount of knowledge children learn as a consequence of study- 
ing that text. Coleman (i960 seems to have been the first person to investigate 
this problem. Me found that students gain less information from texts which are 
very easy or very difficult than from texts at an intermediate level of difficulty. 
Unfortunately, he JiJ not perform this study in a manner that would ailow us to 
determine the exact degree of ease with which a student had to be able to rea I a 
passage in order for him to exhibit this maximum information gain. The study 
which we are about to describe was designed to remedy this fact by determining 
the level of performance a student must exhibit on a cloze readability test made 
from a passage of text in order to exhibit a maximum of information gain on that 
text. This description will be relatively brief since the study was reported in 
detail elsewhere (Bormuth, I960). 

Method of Study ? This study involved four major steps. First, the students 
were formed into matched pairs using their scores on a cloze test constructed and 
used just for that purpose. Second, one member of each pair was given the cloze 
readability test made from a passage in order to determine the degree of ease 
with which that pair of students read the passage. Clozo readability tests are 
made by deleting every fifth word in the passage and replacing the deleted words 
with underlined blanks of a standard length. Students are instructed to write 
in each blank the word they think was deleted. A response is scored correct when 
it exactly matches the word deleted. (See Bormuth, 196C, for a detailed discussion 
of the cloze readability procedure.) 

Third, the other member of each pair was used to determine how much infor- 
mation his pair gained as a result of studying the passage. This was done by 
making a multiple choice, comprehension test for the passage. This test was 
administered as a guessing test to the pair member before he had read the passage. 
About two weeks later this student was given the passage and told to study it. 
Immediately following this he was given the same multiple choice test. The 
amount of information he gained was obtained by subtracting his score on the 
first administration of the comprehension test from the score he made on the 
second administration. Fourth, the cloze readability score made by the one 
pair member was then plotted against the information gain score made by his mate, 
and a curve was fitted to these points. This procedure was repeated using a 
second passage but using the same students. However, the students' roles were 
reversed for the purpose of measuring ease and information gain. 
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A total of 130 different pairs of students were tested. They were drawn 
in roughly similar numbers from grades 3, 5, 7, 11, junior college, and graduate 
level. Because of absences, this number shrank to 12S pairs on one passage and 
125 pairs on the other, do time limits were imposed during the testing, 

Results : All scores were converted to percentage scores. The cloze diffi- 

culty scores were then correlated with the information gain scores. These 
correlations, ,6S' and ,52, were quite high in view of the error necessarily in- 
tro iuced by the matching of pairs. In order to determine the shapes of the 
curves relating scores on the cloze readability tests to information gain scores, 
eighth degree polynomial curves were fit to the set of data from each passage. 
Since these curves were extremely similar, the two sets of data were pooled and a 
single curve fit to the entire set. The curve that resulted is shown in Figure 1. 

The important feature to note in Figure 1 is that students gained little or 
no information when their reading ability was so low that they were unable to 
answer more than about 25 per cent of the items on the cloze readability tests. 

But when they had sufficient ability to answer as many as 35 per cent of the 
items, they were able to gain roughly as much information as students having a 
greater degree of reading ability. 

This result provides us with an important tool for evaluating the effective- 
ness of instruction in reading comprehension. Probably the best criterion for 
evaluating the effectiveness of comprehension instruction is obtained by deter- 
mining if the instruction has prepared the students well enough so that they can 
perform the comprehension tasks which they are required to perform. That is, can 
students gain the information contained in their instructional materials? If a 
student can obtain a score of at least 35 per cent on a cloze readability test 
made from one of his texts, wo can say that he has suf f iciently mastered compre- 
hension skills to perform that task at a satisfactory level. But, if he fails to 
achieve this level on the cloze readability tests made from his instructional 
materials, we must conclude that his instruction in reading comprehension has not 
been adequate to prepare him to deal competently with the kinds of comprehension 
tasks he is required to perform. 
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Comprehension of Instructional llaterials 

The purpose of the second study was to determine the level of reading achieve- 
ment required in order to comprehend the instructional materials used at the 
various major levels in schools. Stated operationally the purpose of this study 
was to determine the reading achievement gra ’e placement scores of students who 
were able to answer 35 per cent of the items on cloze readability tests made from 
materials used at various levels in schools. 
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I would like to express my gratitude to itrs. Barbara tfewey, who served as a 
Research Fellow on this project. She deserves much of the credit for the 
excellent quality of these data. 
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Method of Study : In general outline, this stu !y foil owe I these steps: 

(a) A large number of passages were drawn from instructional materials use' in 
schools, (b) A cloze readability test was male from each passage, (c) These 
tests were administered to students, (3) The California Achievement Test: 

Readinq was administered to the same students to obtain their grade placement 
scores, (e) An’, finally, a set of calculations were performed to determine for 
each passage the reading achievement, grade placement score of the average student 
who was able to answer 35 per cent of the cloze test items on that passage. This 
number can then be interpreted as the average amount of instruction a child must 
receive in order to acquire the information contained in that passage. 

The passages, 200 in all, were drawn in equal numbers from the materials 
used in the primary, intermediate, junior high school, and high school grades. 

But before doing so, the curriculum was divide 4 into ten subject matter areas an 1, 
when the passages were drawn, they were drawn in equal numbers, 20, from each area, 
with seven passages at each school level. Each passage was about l 10 words in 
length and no two passages were written by the same author. 

Five forms of a cloze readability test were made for each passage by deleting 

words l, 6, l l, etc., to make the first form, words 2, 7> 12, etc., to make the 

second, and so on until all five of the forms possible had been made from the 
passage. This operation was necessary because a cloze test samples only a portion 
of the words in a passage and therefore the difficulty of a particular test form 

depends to some extent upon which words happened to be deleted. In tests as 

short as those used in this study, this could seriously bias the results unless 
this source of bias were eliminated by simply using all five cloze test forms. 

Each cloze test form was given to roughly 57 students, with no student taking 
different forms of the same test. A population consisting of about 3,000 students 
was selected from schools in the suburbs of a large midwestern city. The students 
were enrol lei in gra !es through 12 with about equal numbers coming from the 
intermediate, junior high school, and high school levels. This population was 
divided into 50 groups matched on the basis of their achievement test scores and 
each group took, over a period of two weeks, tests over 2C of the passages. 

The analysis of the data was accomplished in three steps. First, the scores 
of students taking different forms of the same test were pooled yielding 205 
scores on each passage. Second, the students* scores on each passage separately 
were regressed on their reading achievement, grade placement scores using a third 
degree polynominal regression model. Third, the third degree polynomial regression 
equation was then used to calculate for each passage the reading achievement, grade 
placement score of the average student who was able to answer 35 per cent of the 
items on the cloze readability test made from that passage. 

The grade placement number obtained for each passage was interpreted as the 
average amount of instruction students in the norm population of the California 
Achievement Test had to receive in order to obtain a score of 35 per cent on that 
passage. Since the norm population on the California Achievement Tests is broadly 
representative of children in the United States, this number can be taken as 
representative of the children in most schools in the United States. 



Table 1 



Mean Grade Placement Scores of Students ’.'ho were Able to 
Answer 35 Per Cent of the Items on Cloze Readability Tests 
Made from Instructional Materials 



Subject 

Matter 

Category 


Gra 


Je Levels at 


'.hich Materials are Use d 




Primary 


Inter- 

mediate 


Junior 
High School 


High 

School 


Row 

Means 


Chemistry 


7.6 


9.2 


:.5 


10.6 


9.2 


Civics 


7.6 


9.0 


9.3 


9.; 


0.3 


Current Mews 


7.1 


0.5 


9.8 


10.5 


9.0 


Economics 


7.5 


9.0 


10.3 


10.2 


..2 


Geography 


7.7 


0.6 


r 

V J 


10.C 


5.0 


History 


.”.2 


3.7 


0.9 


10.0 


: .0 


Literature 


7.7 


0.9 


10.0 


10.9 


,/• * 


Mathematics 


7.1 


0.6 


9.0 


10.9 


9.1 


Physics 


7.7 


7.3 


' • o 


10.0 


0.5 


Biology 


7.0 


0.5 


0.5 


9.9 


3.7 


Column Means 


7.6 


r-' / 

• J 


• <* 


10. ’t 





A summary of these Jata appear in Table 1 which presents the mean grade 
placement score for the seven passages used at each school level in each subject 
matter category. This number represents the mean of the grade placement scores of 
students who were able to answer 35 per cent of the cloze test items on those 
passages. 

An important fact stands out in these results. Chilcren normally do not 
achieve enough comprehension skill to read even the simplest instructional material 
until they have reached the sixth month of the seventh grade. Bear in mind chat 
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the simplest materials were drawn from the materials used in grades 1 through 3. 
Since children in the primary grades almost never reach these levels of achieve- 
ment, it seems doubtful that primary graJe children learn anything from their 
materials. Lest it be thought that this result arose as an artifact of averaging 
many widely varying scores, it should be mentioned that even the easiest passage 
in the entire set required a grade equivalent of in order to answer 35 per 
cent of the items on the cloze test made from it. 

The picture improves only slightly at the intermediate level where an average 
grade equivalent of 3.6 is required in order to reach the cloze criterion score 
of 35 per cent. It is true that a few children in the intermediate grades manage 
to attain this level of reading ability. Even so, this group seldom constitutes 
as much as 10 per cent of the children in even a classroom of very able sixth 
grade students, 

• 

At the higher levels we see what, at first glance appears to be an improved 
situation. One-half of the ninth grade students can, by the middle of the year 
perform adequately on their instructional materials and by the middle of the 
tenth grade half of the students can gain the knowledge contained in half of the 
materials used at the high school level. But this situation is probably worse 
than it at first appears. These results may have come about because the poorer 
readers have by this time dropped out of school rather than because the schools 
are making vast strides in teaching children to comprehend what they read. 

It is an ugly fact that the junior high school and early high school years 
function to drive out the less able students. It is during these years that 
children reach the upper limit of compulsory school attendance an J it is during 
these same years that much of the inci fence of school drop out occurs. Since 
the drop out rate is greatest among the less able students, we see that the 
better performance by junior high school and high school students is in some 
major proportion attributable to the fact that the poorer students are no longer 
present to pull down the averages on achievement test norms. Hence, we must 
conclude that most of the stuJents of high school age probably have not developed 
sufficient reading skill to understand their instructional materials. It seems 
equally justified to conclude that just those students who developed sufficient 
comprehension skill to understand their instructional materials have been able to 
stay in school. 

Because this study employed some rather unfamiliar testing procedures, and 
because its results are so gloomy, we are tempted to blame the outcome on the 
tests and forget the whole thing. Ve would justify this by arguing that, ha ■! 
the children been given a more familiar type of test, the children would have 
performed better. The next study preempts this argument by showing that children 
perform very poorly on the familiary type of comprehension questions testing the 
most basic type of comprehension skills on extremely simple tests. 
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Chi 1 >en's Comprehension or Simple Linguistic Structures 

The purpose or this stu ly was to Jetermine how well children can un 'erstan ! 
the simple factual information signalcJ by the structures commonly foun^ in 
v/ritten language {Bormuth, Hanning, and Carr* If'oC). Their comprehension of 
three classes of structures were examine J -- syntactic structures appearing 
i/ithin sentences, anaphoric expressions, an I syntactic relationships between 
sentences • 

The within-sentence structures stuiieJ were modifications such as the noun 
plus relative clause combination of boy who was little in the sentence The boy, 

«.;ho was 1 ittie roJe the horse . The most common way to test a student's compre- 
hension of these structures is with wh- questions 1 ilce ,( hich boy rode the horse? 

A total of 25 different wi thin-sentence structures were include i in this study. 

Anaphora are pronoun-like structures which refer back to or replace and 
usually abbreviate an antecedent structure. Pronouns are one class of anapnoric 
expressions but there are also several other types such as the word JJM in BiJJ_ 
came. Mary Ji d. too, where di d stan is for the verb phrase of the preceding 
sentence. Some types of anaphoric expressions may replace even an entire 
preceeJing section of discourse, but this stuJy included only the simplest types, 
those whose entire antecedent was located in the sentence immediately preceeding 
the one containing the anaphoric expression. Comprchens ion of anaphoric express- 
ions is tested using questions like '/hat did Mary do? which require the stu lent 
to de»nonstratc his knowledge of the anaphoric expression by giving it in answer 
to a question derived from the sentence containing the anaphoric expression. In 
this study l':- types of anaphora were teste J. 

The relationship between sentences signals information not signaleJ by the 
sentences themselves. For example, the pair of sentences Jo e fell off the horse. 

He broke his arm, states that Joe's falling off the horse caused the breaking 
of his arm. But when the order of the sentences is reverse], their relationship 
signals that the breaking of the arm cause J Joe's falling from the horse. These 
relationships are tested using questions like Vhat cause 1 Joe t o break his arm? 
There seems to be only about 15 different types of relationships between sentences. 
This study teste 1 all 15 of those so far identified. 

Method of Study : The comprehension of all three types of structures is 

coiiTrtonly tested wi th just four question types — rote, transform, semantic 
substitute, and compound questions. Since they have been rigorously defined 
eisewhere (Bormuth, 1j?63) only illustrative examples will be given here. Start- 
ing with the sentence The 1 ittie boy ro Je the horse we can derive the rote question 
Which boy rode the horse? by leTeting the phrase to be tested, replacing it with 
the appropriate wh- pro-element, ari J shifting the pro-element to the front of the 
sentence, unless it was already there. A transform question is ieriveJ by perform- 
ing some sentence transformation such as the cleft on the rote question as in, for 
example, Vhich boy. was it who ro ?e the horse? A semantic substitute question is 
derive) by replacing one or more of the phrases in the rote question with a synonym 
and thus obtaining questions like Vtiich lad rode the horse? A compound question 
is made by simply performing both the semantic substitute an ! the transform oper- 
ations to the same rote question. All structures were tested using all four 
question types. 




The test materials v/ere made in this way. Sentences v/ere written to provide 
two examples of each structure* A four or five sentence paragraph was then 
written to incorporate each example. Jo sentence contained more than one embe i- 
ding an- none contained a sentence transformation such as the cleft or passive, 
so the syntactic complexity of the sentences was kept at a minimum. All v/orJs 
use i in the paragraphs were selected from the hale List of 3000 Easy './or is, keep- 
ing the vocabulary difficulty at a minimum, also. 

Each paragraph was printeJ on a separate sheet of pa^r and the appropriate 
question was printeJ directly below the paragraph, Jo stu jnt answered more than 
one of the question types pertaining to a paragraph. Roughly 2:0 students v/cre 
teste J with these materials, about 50 responding to each question. These students 
were all in gra !e an ! they v/cre drawn in about equal proportions from a rural 
school, a suburban school, on J a Jegro ghetto school in or near a large mi .’western 
c ty . Jo time limits v/ere imposed during the testing an ! the children were per- 
mitted to refer back to the paragraphs while answering the questions. The scoring 
procedure used was rigorous an ' explicit, but it v/oul ! generally be consi Jere ’ 
generous in scoring responses correct (Carr, Pearson, 3ceson, 19 oj). 

Each question was score ’ to determine the percentage of stu ’ents answering it 
correctly. An analysis of variance showed that the structures differed signifi- 
cantly in Jiff let* l ty and that the difficulty rankings were reliable (r = *C). The 
difficulty of each structure was then determine' by averaging the difficulties 
determine 1 by the four question types and the two examples of each structure. The 
results are shown in Table 2. 

Again, the children's performances v/ere impressively low. Almost one fourth 
of the chi l dren v/ere unable to demonstrate their comprehension of half of the 
easiest sets of structures tested, the v/i thin-scnto.icc and the anaphora structures. 
Even the easiest structure tested attracted correct responses from only 0" per 
cent of the chil ren. This amounts to saying that a very substantial proportion 
of our chil 'ren are not able to demonstrate an un IcrstanJing of the information 
signaled by the simplest and most basic features of the language. 

It was equally alarming to discover that only about 5C per cent of the 
children coul ! Icmonstrate that they understood the information signaled by the 
between -sentence syntax of the paragraphs. As children advance in school, an 
increasing amount of their instruction is presented in the form of lengthy dis- 
course v/hich is carefully organized. This organization is the between-sentence 
syntax tested here. That organization transmits a considerable portion of the 
information about the structure of the content the child is studying, a type of 
content educators value highly because it permits children to deal with the con- 
tent on increasingly higher levels of abstraction. These lata seem to show that 
much of this information is lost on most of the chil Iren, at least on those in 
fourth grade. 

It is currently popular among linguists, and a few psychologists, to claim, 
without evidence, that nearly every child by ago 5 has mastered the production 
of virtually every syntactic structure in the language. If the data from the 
present stu ly aro correct either the child, the linguist, or possibly both loesn' t 
un 'erstanJ what he is talking about. A possible alternative is that the reading 
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Tabl e 2 

Percentage of Correct Responses on Questions Testing Students' 
Comprehension of Three Types of Linguistic Structures 



Type of Structure 


• lean 


SD 


Lowest 


Highest 


Vj i th in-Sentence 


.73 


.12 


.20 


• ’ JO 


Anaphora 


.77 


.12 


.o'j 


O 7 
• «->/ 


Between-Sentence 


.53 


.12 


.33 


70 
• / > 



and testing tasks present difficulties, such as worJ recognition difficulties, 
which prevent the children from demonstrating that they can comprehend the 
structures tested. This explanation is somewhat doubtful in view of the fact 
that the materials contained very easy vocabulary and the children having 
severe word recognition problems constituted only about 5 per cent of the 
sample of children studied. 

However, even if we were to grant the proposition that the poor performance 
of the children was due entirely to factors specific to the reading testing 
situation, the total picture would improve very little for the school treats an 
incorrect response the same regardless of whether it arose from a fundamental 
failure to understand language, a failure to understand just the written form of 
the language, or just a failure to understand and answer the questions. 
Operationally, a wrong response to a question is interpreted as a failure and the 
path from there is well known. Frequent failures lead to more failures and 
finally to school drop out which provides the child with a good head start on a 
career of bigger and more serious failure. 



The School's Influence on the Child's 
Comprehension Skills 

V/e must now ask what influence, if any, the school's comprehension instruc- 
tion has upon the child's comprehension skills. This turns out to be a difficult 
question to answer. The studies just described show that vast numbers of chil* 
dren are unable to rea 1 well enough to acquire the knowledge contained in their 
textbooks and that a discouragingly small proportion is able to demonstrate a 
comprehension of even the most basic sentence structures by which language signals 
information. But this is not sufficient evidence with which to evaluate the 
claims that comprehension instruction either is or is not effective. It could be 
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that the instruction causes great improvement in the comprehension abilities or 
the children but that the task is so large an.! complex that it cannot be 
accompl ished within the limits of the resources allocated to that branch of 
instruction. 

Let us first dispose of the evi fence which is, at once, the most obvious 
and the most useless. The studies in which norms were developed for the 
standar Jized tests of reading achievement can be regarded as experiments involv- 
ing huge samples of American school children. The results of these studies 
show that children’s scores on the reading comprehension tests exhibit a clear 
pattern of increases from one grade level to the next. Out these results are 
far from definitive, ’/e know that children's comprehension skills will show 
similar increases in the total absence of formal instruction, witness the 
remarkable growth made by children between the ages of two to five. For this 
reason, our problem here is to determine if the instruction produces any effect 
over and above that produced by the child's non-school environment. 

Let us also dispel any hope that we might obtain direct evi fence on this 
matter. In order to do so we would have to provide formal instruction for one 
group and withhold all instruction from a comparable control group. The control 
group could not be given any formal instruction unless, possibly, we were prepared 
to defend the unlikely proposition that instruction in comprehension is confine ! 
entirely to one segment of the instruction. Obviously, such an experiment is 
ethically unacceptable and operationally impractical, so we must rely on indirect 
evidence to decide this issue. 

One line of reasoning appears to be especially helpful. ! de know that the 
home language environments of children differ considerably in the degree to which 
they prepare children to understand the language used in schools. Our chief 
evidence for this assertion is the commonly observed fact that there is a high 
correlation between the social, economic, and racial characteristics of the 
child's home environment and his score on the language achievement tests ' 5 we give 
him as he enters school. Second, the teacher is the most effective agent of 
instruction provided he is given both a clear idea of what it is he is supposed 
to teach and the materials with which to accomplish the task. 

If these two propositions are accepted, then we would expect the differences 
in skill among teachers to produce large differences in children's comprehension 
abilities. That is, teachers who were energetic and resourceful in teaching read- 
ing comprehension would produce large effects on the children's skills while 
teachers with less energy and skill would produce a smaller effect on the chil" 
dren's performance. And the teacher's influence shoul ! tend to offset the 
influences of the home environment. Out if the teacher is unclear about what he 
is to accomplish or is not supplied with effective materials, he can have little 
effect on the child, an! the child's home background will be the dominant variable. 



3 . The fact that these tests are often labeled as intelligence tests shoul ! not 
be allowed to mislead us. Large portions of these tests, in fact, measure 
nothing more than the degree of skill a child has attained in comprehending 
language. 



ERIC 



12 



Table 3 

Variation Attributable to Individual Differences among Pupils, 
Classrooms, and Schools (Home Background), Expressed as 
Percentage of the Total Variatipn of the Scores on Each Test* 



Test 




Source of Variation 




Pupils 


Classrooms 


Schools 


1, ’./ord Meaning 


20.3 


17.7 


62.0 


2 . Paragraph Meaning 


19. 


17.7 


55.3 


3. Spelling 


34.3 


12.9 


52.2 


b. Language Mechanics 


19.0 


30.1 


30.7 


5. Arithmetic Computation 


17 . c 


O'. f 0 


r>.2 


3. Arithmetic Concepts 


on 

c *. mU 


z-n 0 


11.2 


7. Arithmetic Applications 


OO 

• > 


n 7 r 

j : • . 


32.2 



* Adapted from Table 2, page 359* in v /i ley, D. E., and Bock, D. R. 
"Quasi -experimentation in Educational Settings: Comment." School 

Review. 7£, 353-3^6, (1;37). 



Table 3 shows some results obtained in a study conducted by V/i ley and dock 
(IS'67). These data were gathered by administering a battery of achievement tests 
to all of the fifth gra ie children in all ten of the elementary schools in a 
single school district in northern Illinois. Since these schools were attended 
primarily by children who lived in small, relatively well defined neighborhoods, 
and since these neighborhoods differed considerably in socio economic character- 
istics, a major portion of the differences in the performances of children at the 
various schools can be attributed to differences in their home backgrounds. The 
numbers in the columns of this table show the percentages of the variation among 
students' scores which are attributable to differences just among pupils, differ- 
ences just among teachers, and differences among schools or neighborhoods on each 
of the tests shown. 




13 



These data show that teachers have proportionately little effect upon their 
pupil's comprehension skills* the variation among teachers accounting ror only 
1 3 per cent of the total variation in comprehension and vocabulary scores. 

According to the line of reasoning being followed here, the teachers are able to 
have little effect upon the child's comprehension skills because they have neither 
a clear concept of what is to be taught nor materials designed to shape the com- 
prehension skills efficiently. As a result, influences in the chillis general 
'"encjuage environment become the dominant factor in the development of his compre- 
hension skills. This is shown by the fact that, on those same tests, 62 to -'5 
per cent of the variation was !ue to differences between schools. This is over 
three times the effect produced by the differences in instruction given by 
different teachers. 

Q,uite the reverse was true on the arithmetic computation and concepts tests. 

In these subject matters the content is well defined and the materials are designed 
to produce the desired behaviors efficiently. Spelling scores present an extreme 
case where the materials and procedures are so thoroughly programmed that the 
instruction depends chiefly upon the pupil's own capabilities an' upon his know- 
ledge of his language. Arithmetic application scores exhibit a fairly large 
variation between schools principally because the solution of written problems 
depends in part upon the child's ability to comprehend the story problems. 

These data do not rule out the possibility that even the weakest teacher 
produces a very large effect upon the child's comprehension skills and that, 
when this effect is compared to the effects produceJ by variations among teachers 
and the effects due to home environment, only the basic effects produce.! by the 
teachers are important. Thus, we must turn to the examination of the procedures 
themselves for soitie light on this matter. 

The assertation that the content of instruction in reading comprehension is 
ill Jefined is easily verified. Textbooks on the teaching of reading usually 
carry a chapter or two on teaching comprehension skills. But these discussions 
are so vague as to be almost useless to a teacher, for example, they exhort tno 
teacher to teach the children such skills as "comprehending the important facts, 
seeing the important relationships, grasping the main i-ea" and the like. 3ut 
definitions of these skills never explain what a fact might be or how to decide 
which facts are important. Thus, if a teacher is faced with the sentence The 
little boy mounte l the horse, he has no way to decide if the sentence contains 
numerous facts such as that the horse was mounted, that the boy mounted something, 
that the boy was little and so on. How the teacher would decide which were the 
important facts is left equally obscure. 

And, aside from a few general admonitions to avoid focusing the child's 
attention on "mere" facts, the teacher is given little help in developing exercises 
which are appropriate for teaching the comprehension skills. The teacher is seldom 
shown examples of appropriate practice questions nor is he ever told how to 
construct them. The child's instructional materials provide the teacher with 
little, if any, help an ! the locally prepared curriculum guides are almost 
equally barren, '/hat few exercises they contain appear generally unsystematic. 
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’.bile this discussion is far from conclusive, it has provide i a strong 
support for the proposition that the instruction in schools is relatively inef- 
fective as an agent for increasing children's reading comprehension skills. 
Bather, a major portion of whatever gain the chil i exhibits in comprehension 
skills must be attributed to what he has acquired from his language environment. 



Summary 

For many years reading experts and educators in general have maintained that 
the ultimate objective of reading instruction was to enable the child to under- 
stand what he read and not just to enable him to call the words on the page. And 
they have argued that this is the objective upon which we should expen! our 

major efforts, since it is only through the chil J's use of these skills that he 
is able to acquire much of the knowledge he wi 1 1 need throughout his life. On 
the whole, this argument seems well reasoned. 

Out when we examine how well this goal is being accomplished we find a rather 
discouraging situation. Children are not able to read their instructional materials 
well enough to gain much information from them until the children reach high 
school. Even in high school a large proportion of the materials remain essentially 
incomprehensible to a large proportion of the students. Furthermore, the apparently 
improved ability of the high school student may in fact have resulted merely 
because the less able students, the students who were unable to rea ! well enough 
to learn the content of their instruction, have failed in school, dropped out, and 
are no longer present to pull down the average performance to its true level. 

A more detailed analysis of children's comprehension skills showed that in the 
fourth grade a great many of the children were unable to exhibit comprehension of 
even the simplest structures by which language signals information. 

However, this is not sufficient grounds upon which to indict the procedures 
used to teach reading comprehension. It could be that the task is so complex that 
the resources devoted to its accomplishment are simply too meager to accomplisn the 
desired results. However , an analysis of the materials used to teach comprehension 
skills and of the curriculum guides and textbooks ’which instruct the teacher in how 
to teach those skills tends to suggest instead that there is no clear concept of 
what skills are to be taught. Furthermore, the teaching procedures are described 
in only the vaguest of terms, terms that hardly seem helpful to teachers. 

There is no direct evi dence on whether the procedures used to teach rea ding 
comprehension are in any way responsible for the increase in children's compre- 
hension skills. bat evidence there is suggests that whatever the magnitude of 
this effect it seems relatively small when compared to the effects exerte by 
chil J's general language environment. 

In the final analysis, we cannot, at present, definitely reject our present 
procedures for teaching reading comprehension, but we must voice grave doubts about 
their efficacy. And we can definitely say that they do not produce sufficient 
results to enable children to profit from much of their reading. 
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